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(57) Abstract: A storage area network and method for defining a static Fibre Channel 
Fabric that does not require a Principal Switch. The storage area network comprises 
one or more hosts, one or more storage devices, and a static Fabric connecting the one 
or more hosts and storage devices. Within the static Fabric, the Switches have their Do- 
main_ID and Fabric_Name statically set. The method comprises accessing the Fabric, 
selecting a Switch in the Fabric, and statically configuring the Domain_ID and Fab- 
ric_Name for the selected Switch. The above sequence is repeated for each Switch in 
the static Fabric. In one embodiment, after being statically configured, the Switch is 
isolated from any dynamically set Switches in the Fabric. The Switch detects which 
of its Ports are connected to djmamically set Switches, and then isolates them, while 
maintaining operational the Ports connected to statically configured Switches. 
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PATENT APPLICATION 



Apparatus and Method 

FOR 

5 Defining A Static Fibre Channel Fabric 



BACKGROUND OF THE INVENTION 



1. Field of the Invention 

The present invention relates to storage area networks, and more particularly, 
10 to an apparatus and method for defining a static Fibre Channel Fabric which does not 
require a Principal Switch. 

2, Background of the Invention 

With the increasing popularity of Intemet commerce and network centric 
computing, businesses and other organizations are becoming more and more reliant on 
15 information. To handle all of this data, storage area networks or SANs have become 
very popular. A SAN typically includes a number of storage devices, a number of 
hosts, and a plurality of Switches arranged in a Switching Fabric. The Switches 
selectively connect the storage devices and the hosts within the SAN. 

Most SANs rely on the Fibre Channel protocol for communication within the 
20 Fabric. For a detailed explanation of the Fibre Channel protocol and Fibre Channel 
Switching Fabrics, see FC-FS (Fibre Channel Framing and Signaling) and FC-SW-2 
(Fibre Channel Switch Fabric - 2), incorporated by reference herein for all pixrposes. 

In Fibre Channel, each device (hosts, storage devices and Switches) is 
identified by an unique eight (8) byte wide Node_Name assigned by the manufacturer. 

25 Wlien the Fibre Channel devices are interconnected to form a SAN, the Node_Name 
(together with other parameters) is used to identify each device. Fibre Chamiel frames 
are used for communication among the devices in the SAN. The Node_Name, 
however, is not used by the jBrames. Instead the Fibre Channel Port of each end device 
(hosts and storage devices) is addressed via a three (3) byte Fibre Channel address (or 

30 FC_ID), allocated dynanaically to the end devices by the Fabric. Each end device 
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acquires its FC__ID by performing a Fabric Login procedure with the Switching Fabric. 
In this procedure, the end device and the Fabric exchange their credentials and the 
operating parameters required for a successful communication across the SAN. 
Initially the Fabric identifies itself by an unique Fabric_Name and the end device by its 
5 uniqixe NodeJNfame. Thereafter the Fabric assigns the FC_IDs to the Ports of the end 
devices. 

The three byte wide Fibre Channel addresses are hierarchically structured in 
three fields, each one byte long: Domain_ID, AreaJQD, and Port_ID. Each Switch 
within the Fabric is assigned a Domain__ID. The end devices attached to a particular - 

10 Switch are assigned the Domain JD of that Switch. The Switch manages the allocation 
of the AreaJDD and Port JDD fields for each end device to guarantee the uniqueness of 
the assigned addresses in that Domain. For example, if a Switch is assigned a Domain 
number five and the Switch subdivides its address space in two areas each having three 
connected end devices, then a possible Fibre Channel address allocation is: 5:1:1, 

15 5:1:2, 5:1:3, 5:2:1, 5:2:2, and 5:2:3. 

When the Switching Fabric initializes, one of the Switches is selected as the 
Principal Switch. The Principal Switch assigns the Domain JDs to all the Switches in 
the Fabric and its NodeJName becomes the Fabric_JSrame of the Switching Fabric. To 
select the Principal Switch, all the Switches exchange with each other a message called 

20 Exchange Fabric Parameters (EFP). The EFP contains, among other parameters, the 
NodeJName of the sending Switch. The Switch with the lowest Node_JSfame is 
designated as the Principal Switch. All the other Switches are referred to as non- 
principal Switches. Once the Principal Switch is selected, it sends to its neighbor 
Switches a Domain Identifier Assigned (DIA) message, which informs the neighbor 

25 Switches that it has been assigned a Domain_ID by the Principal Switch. In reply, the 
neighbor Switches send a Request Domain Identifier (RDI) message to the Principal 
Switch. The Principal Switch allocates the Domain_IDs and responds by sending each 
Switch its Domain_ID. Thereafter, the Switches that received a Domain_ID send a 
DIA to their neighbor Switches, receive an RDI in reply, and forward the RDI to the 

30 Principal Switch, which assigns the Domain JQDs to the requesting Switches. This 
process continues until all the Switches received a Domain_ID. After having received 
a Domain__ID, the individual Switches assign the Area_IDs and PortJQDs for each end 
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device in its Domain. The Fabric configuration is considered completed when all the 
Switches have been assigned a Domain_n). Consequently the end devices axe all 
assigned their Area_IDs and PortJDDs. 

Fibre Channel allows the merging of two separate Switching Fabrics into one. 
5 This happens when a connection is established between two Switches each belonging 
to a different Fabric. When such an event occurs, the Domain_ID of some of the 
Switches and the FC_ID of their end devices of the merged Fabric may need to be 
reassigned- For example, if a Fabric A which includes Domain_IDs one, two and three 
(1, 2 and 3) is to be merged with a second Fabric B which includes Domain__IDs one 
10 and two (1 and 2), then the overlapping Domain_IDs (1 and 2) of one of the Fabrics 
must be reassigned. When two Fabrics are connected, an EFP message is exchanged 
across the link that connects them to determine if there is any overlap among the 
Domain_IDs. Depending on the outcome, one of two things may happen. 

If there is any overlap of Domain__ID assignments among the Switches, tiie liiik 
15 that connects the two original Fabrics is isolated. The link is logically disconnected 
and is not recognized by the devices, although the physical link still remains. A SAN 
administrator may then request a disruptive reconfiguration of the joined Fabrics to 
resolve the Domain^E) conflict. In this case a Reconfigure Fabric (RCF) message is 
flooded across all the Switches of the two original Fabrics. This stops the delivery of 
20 all the data traffic, and each Switch revokes its Domain_ID. Thereafter, a Principal 
Switch is selected, new Domain_IDs are assigned to the Switches, and new FC_IDs 
are assigned to the end devices in the same way as described above. In this manner, the 
two Fabrics are merged into one. 

If there is no Domain_ID overlap among the Switches, then a non-disruptive 
25 Fabric reconfiguration is automatically performed. A Build Fabric (BF) message is 
flooded across all the Switches of the two original Fabrics. Data frames delivery is not 
stopped, and each Switch keeps its DomainJD. Siace the two Fabrics each have a 
Principal Switch, one of the two has to "resign" firom its principal status leaving only 
one Principal Switch for the merged Fabric. Consequently the Principal Switch 
30 selection process described above takes place. Each non-Principal Switch then makes 
an RDI request to the surviving Principal Switch asking for the same DomauiJD that 
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it had before the BF message. In this way, the two Fabrics are merged without 
changing any Switch Domain_ID assignments or any FC^DDs assigned to the end 
devices. 

For one of the two original Fabric, however, the Principal Switch is changed. 
5 Consequently the Fabric_Name for those Switches needs to be updated. Given that the 
Fabric_JName is part of the Fabric Login state information that each end device 
maintains, the Switches of the loosing Fabric have to re-initiahze their end devices to 
update their status. This process causes a disruption of the data traffic in the Fabric 
with the losing Principal Switch. 

10 A number of problems are associated with the way Domain_IDs are assigned 

among the Switches of a Fabric under the current Fibre Channel standard. Foremost, 
the Principal Switch is selected dynamically. In other words, the Prmcipal Switch is 
selected "on the fly" when the Fabric is initially configured or whenever a change to 
the Fabric is implemented. Further the RCF and BF processes are disraptive to the 

15 Fabric. When the RCF process is invoked, all the traffic across the merged Fabric is 
halted while the Principal Switch is identified and the DomainJDs are re-assigned. 
The BF process is also partially disruptive. Traffic continues in the Fabric where the 
original Principal Switch continues to be the Principal for the merged Fabric. With the 
other Fabric, however, the Switches must be updated to reflect that they are included in 

20 a new Fabric. Traffic is thus dismpted until the update is completed. Further, Fabrics 
with Principal Switches are prone to catastrophic problems. For example, if tire 
Principal Switch goes down, it may render the entire Fabric inoperable. Also if a cable 
is mistakenly plugged into the wrong connector, inadvertently connecting together two 
Fabrics, it may cause the entire Fabrics to be reconfigured. 

25 An apparatus and method for defining a static Fibre Channel Fabric that does 

not require a Principal Switch is therefore needed. 

SUMMARY OF THE INVENTION 

To achieve the foregoing, and in accordance with the purpose of the present 
invention, a storage area network and method for defming a static Fibre Channel 
30 Fabric that does not require a Principal Switch is disclosed. The storage area network 
comprises one or more hosts, one or more storage devices, and a static Fabric 

4 
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connecting the one or more hosts and storage devices. Within the static Fabric, the 
Switches have their DomainJ© and Fabric_Name manually set. The method 
comprises accessing the Fabric, selecting a Switch in the Fabric, and manually setting 
the Domain^ID and FabricJSTame for the selected Switch. The above sequence is 
5 repeated for each Switch in the static Fabric, In one embodiment, after being statically 
configured, the Switch is isolated from any dynamically set Switches in the Fabric. 
The Switch detects which of its Ports are connected to dynamically set Switches, and 
then isolates them, while maintaining operational the Ports coimected to statically 
configiured Switches. 

10 BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a Switching Fabric of a storage area network. 

Figure 2 is a flowchart illustrating the sequence for defining a static Fibre 
Channel Fabric according to the present invention. 

Figure 3 illustrates an exemplary static Fibre Channel Fabric isolated from a 
1 5 dynamically set Fibre Channel Fabric according to the present invention. 

DETAILED DESCRIPTION OF THK PREFERRED EMBODIMENTS 

In the following description, numerous specific details are set forth in order to 
provide a thorough understanding of the present invention. It will be obvious, 
however, to one skilled in the art, that the present invention may be practiced without 
20 some or all of these specific details. In other instances, well known process steps have 
not been described in detail in order not to unnecessarily obscure the present invention. 

Referring to Figure 1, a Switching Fabric of a storage area network is shown. 
The storage area network (SAN) 10 includes a Switching Fabric 12 that includes a 
plurality of Fibre Channel Switches SWl through SW6. Also included in the SAN 10 
25 are a plurality of hosts HI through H6 and a plurality of storage devices Dl tlirough 
D5. A tool to manage the Fabric, such as a command line interpreter or a graphic 
management appUcation 14, is connected to the Fabric 12 through the host H4. The 
coinmand line interpreter or management application 14 enables a network 
administrator 16 to manage the Fabric 12 through the host H4 and Switch SW4. 

5 
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According to various embodiments of the invention, the hosts H1-H6 can be 
any type of host including but not limited to servers or personal computers running on 
either the Unix, Windows, or any other computing platform, or a combination thereof. 
Similarly, the storage devices D1-D5 can be any type of storage device including but 
5 not limited to tape back-up systems, emulated tape back-up systems, CD-ROM storage 
arrays, or one or more disks such as a Redundant Array of Independent Disks (RAID), 
or a combination thereof. The Switches SW1-SW6 can be any type of Fibre channel 
Switch such as those commercially available from Brocade of San Jose, CA or 
Andiamo Systems, the assignee of the present application. It should also be noted that 
10 the Fabric 12 as shown in the figure is merely illustrative of a SAN useful for 
describing the present invention. In no way should its simplicity be constmed as 
limiting the present invention which may be used in any SAN configuration. 

The present invention provides a way to manually configure the Switches SW 
of the Fabric 12. This technique can be used either when the Fabric 12 is initially 
15 configured or if a network administrator would like to implement a change across the 
Fabric 12 after it is in operation. 

Referring to Figure 2, a flowchart 20 illustrating the sequence for defining a 
static Fibre Channel Fabric according to the present invention is shown. When a 
network administrator 16 wishes to statically define the Fabric 12 (Box 22), the 
20 administrator fibrst accesses the Fabric 12. In various embodiments, this is 
accomplished through either the command line interpreter or management application 
14 (Box 24). 

Once access to the Fabric 12 is established, the administrator selects a Switch 
SW to be statically configured (Box 26). The domain manager (the component of the 

25 Switch that implements the Principal Switch selection and Domain_ID assignment 
state machine) of the Switch SW is then disabled by the administrator (Box 28). 
Disabling the domain manager necessitates a significant change in the working mode 
of the Switch. Thus when the domain manager is disabled, the Switch brings down all 
its Ports, including those connecting to other Switches and those connecting to the end 

30 devices. Once the domain manager is disabled, the administrator statically configures 
(i.e. manually writes) in the memory of the Switch an appropriate Domain__ID and 
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FabricJSFame. After the Domam__ID and FabricJSTame are statically configured, the 
Switch then brings up all its Ports (Box 30). End devices connected to Ports are 
assigned their FCJDs using the statically configured infomnation using the standard 
Fabric_Login procedure. In an alternative embodiment, the administrator may 
5 configure the static DomainJDD and FabricJMame before disabling the domain 
manager. In this situation, the Switch will not use the statically configured Domain JD 
and FabricJSTame until the domain manager is disabled. 

After being statically configured, the Switch is isolated from any dynamically 
set Switches in the Fabric 12. The Switch detects which of its Ports are connected to 

10 dynamically set Switches, and then isolates them, while maintaining operational the 
Ports connected to statically configured Switches, The detection algorithm is based on 
the Switch Ports behavior as defined by FC~SW-2. Any Port that receives a message 
used for a Principal Switch selection, such as EFP, BF, RCF, DIA, RDI, indicates that 
the Switch that sent that message was dynamically configured. The statically 

15 configured Switch in response sends a reject (SW_RJT) message to the dynamic 
Switch with reason code explanation "EJPort is Isolated", and then isolates that Port. 
On receiving this message, the dynamically configured Switch is required to isolate its 
Port connected to the statically configured Switch. In this manner, the manually 
configured Switch is logically isolated from any other Switches in the Fabric 12 that 

20 are dynamically configured. The Ports linked to any other statically configured 
Switches do not receive the Principal Switch selection messages (EFP, BF, RCF, DIA, 
RDI) and are therefore not isolated (box 32). 

In decision diamond 34, the administrator decides if another Switch is to be 
statically configured. If not, the sequence is complete. If yes, then the administrator 
25 selects another Switch (Box 26) and the above sequence is repeated. It is responsibility 
of the administrator to define the same FabricJSTame and non conflicting Domain_IDs 
for each of the statically configured Switches. 

It is useftil to clarify the actions performed by the administrator versus the 
actions performed by the Switches. The administrator is required to disable the 
30 domain manager and write the static configuration information for each statically 
configured Switch. The statically configured Switches automatically performs the Port 



7 



wo 03/088050 



PCT/US03/09332 



actions as described above to logically isolate the statically configured Switches from 
dynamically set Switches. No other action is required on the part of the administrator 
to statically define the Fabric 12. 

The present invention thus provides a way to statically configure the 
5 Domain_ID and Fabric JN"ame for each Switch in the Fabric 12. Additionally, the 
present invention provides a method for the Switches to determine if a statically 
configured Switch is connected to a dynamically configured Switch or to another 
statically configured Switch. Furthermore, the Switches that are statically set are 
considered peer-to-peer equals. In other words, the present invention can be used to 
10 define a static Switching Fabric that does not require a Principal Switch. 

Referring to Figure 3, an exemplary Fabric 40 having several Switches SW 
that have been statically configured is shown. In this example, three of the Switches 
SW4, SW5 and SW6 have been statically configured as described above. The 
remaining Switches SWl, SW2 and SW3, however, have been dynamically 

15 configured. As described above, whenever a Switch SW is statically configured, it is 
logically isolated from any dynamically configured Switch SW. The dashed lines 42 
and 44 are representative of the isolated links between Switches SWl and SW6 and 
SW3 and SW4 respectively. It should be noted that the isolation is logical and not 
necessarily physical. In other words, neither data traffic nor configuration messages 

20 flow over the isolated link, except for the link initialization message (Exchange Link 
Parameter, ELP), which may be used to exit from the isolated state in the case that the 
neighboring Switch becomes a statically configured Switch. Thus, in this example, the 
Fabric 40 has effectively been divided into two fabrics that do not communicate witli 
one another. Fabric A includes dynamically set Switches SW1-SW3. Fabric B 

25 includes statically set Switches SW4-SW6. 

Altematively, the present invention also enables an administrator to 
dynamically configure a statically configured Fabric 12. This procedures is essentially 
the same as that described above but in reverse. Initially the administrator is required 
to select a Switch and enable the domain manager of that Switch. According to one 
30 embodiment, when the above occurs the Switch brings down all of its Ports and then 
brings them up again in accordance with the FC-SW-2 standard. Thus the Ports behave 
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in accordance with the FC-SW-2 standard and receive and recognize messages used 
for the selection of a Principal Switch, such as EFP, BF, RCF, DIA and RDL The 
Switch thus becomes dyaainically configured and is able to communicate with other 
dynamically configured Switches in the Fabric. The aforementioned process is 
5 repeated for each Switch in the Fabric that is to be dynamically configured. 

The embodiments of the present invention described above are to be considered 
as illustrative and not restrictive. For example, the present invention does not 
necessarily have to be used with a SAN. Rather, it can be used by any type of network 
with Fibre Channel Switches that are dynamically set. The invention is not to be 
10 Umited to the details given herein, but may be modified within the scope and 
equivalents of the appended claims. 
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CLAIMS 

What is claimed is: 

1 . A method of defining a storage area network Fabric, comprising: 

statically defining the Fabric by statically configuring the Domain_]D 
and FabricJSfame for each selected Switch in the Fabric. 

2. The method of claim 1, wherein the configuring of the Domain__ID aad 
FabricJSTame for each Switch in the Fabric further comprises disabling a domain 
manager for each Switch. 

3. The method of claim 2, wherein the configuring of the DomainJQD and 
Fabric JName for each Switch in the Fabric further comprises writing the Domain_ID 
and Fabric_Name into a memory for each Switch respectively. 

4. The method of claim 3, further comprising assigning any end devices coupled 
to the statically configured switches their FC_IDs after the Domain_ID and 
FabricJSFame is written into the memory for each Switch respectively. 

5. The method of claim 3, wherein, after the Domain JD and Fabric_Name for 
each Switch is written, logically isolating the Switch from any dynamically configured 
Switches in the fabric. 

6. The method of claim 5, wherein the logical isolation of tiie Switch further 
comprises: 

receiving at Ports of the Switch a first message indicative of the selection of a 
Principal Switch firom any of the dynamically configured switches; 

sending a reject message to any of the dynamically configured Switches that 
sent the first message; and 

isolating the Ports between the Switch and any of the dynamically configured 
Switches that sent the first message. 
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7. The method of claim 6, wherem the message includes one of the following 
types of messages: EFP, BF, RCF, DIA or RDI. 

8. The method of claim 1, further comprising statically configuring the Switches 
by accessing the Fabric through a management application or command line 
interpreter. 

9. The method, of claim 1, wherein the defining the static Fabric fiirther 
comprises: 

a. accessing the Fabric; 

b. selecting a first Switch in the Fabric to be statically configured; 

c. disabling a domain manager associated with the first Switch; 

d. configuring the Domain_ID and the FabricJSTame of the first Switch; 

e. repeatmg b through d for each of the statically configured Switches in the 
fabric. 

10. The method of claim 1, further comprising dynamically defining the statically 
configured Fabric by enabling a domain manager for each selected Switch in the 
Fabric 

11. A storage area network, comprising: 

one or more hosts; 

one or more storage devices; and 

a static Fabric connecting the one or more hosts and storage devices, 
the static Fabric having one or more Switches having their Domain_ID and 
FabricJMame statically configured. 

12. The storage area network of claim 11, wherein the one or more Switches 
having their Domain_ID and FabricJSTame statically configured are peer-to-peer 
equals within the static Fabric. 

13. The storage area network of claim 11, wherein the one or more Switches 
finther comprise an isolation mechanism that is invoked whenever a statically 
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configured Switch is linked to a dynamically configured Switch, the isolation 
mechanism logically isolating the statically configured Switch aad the dynamically 
configured Switch. 

14. The storage area network of claim 11, fiirther comprising a management 
application or command line interpreter coupled to the fabric for accessing the fabric. 

15. A method of configuring a storage area network Fabric, comprising: 

a. accessing the Fabric; 

b. selecting a Switch in the Fabric; 

c. disabling a domain manager associated with the selected Switch; 

d. statically configuring the Domain_ID and Fabric_Name for the 
selected Switch; and 

e. repeating b through d for each Switch in the Fabric to be statically 
configured. 

16. The method of claim 15, fiirther comprising assigning any end devices coupled 
to the statically configured Switches their FC_IDs after the Domain_ID and 
FabricJSTame is written into the memory for each selected Switch respectively. 

17. The method of claim 15, wherein, after the Domain_ID and Fabric_Name for 
each selected Switch is written, logically isolating the Switch firom any dynamically 
configured Switches in the Fabric. 

18. The method of claim 17, wherein the logical isolation of each of the selected 
Switches further comprises: 

receiving at the selected Switch a first message indicative of the selection of a 
Principal Switch firom any of the dynamically configured switches; 

sending a reject message to any of the dynamically set Switches that sent the 
first message; and 

isolating the Ports between the selected Switch and any of the dynamically 
configured Switches that sent the first message. 
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19. The method of claim 15, wherein the Fabric is accessed over a management 
application or command line interpreter. 

20. The method of claim 15, further comprising disabling a domain manager 
associated with the selected Switch before statically configuring the Domain_ID and 
Fabric JSTame for the selected Switch. 

21. A method comprising: 

providing a Fabric, the Fabric having a phirality of Switches, each of the 
Switches having a DomainJD and a FabricJSTame; 
providing an access to the Fabric; and 

enabling the static configuration of the plurality of the Switches of the Fabric 
through the access to the Fabric. 

22. The method of claim 2 1 , fiirther comprising: 

enabling a Switch to be selected among the phirality of Switches of the Fabric 
through the access; and 

disabling a domain manager associated with the selected Switch before the 
static configuration of the Domain_ID and Fabric JS[ame for the selected Switch. 

23. The method of claim 22, wherein, after the Domain_ID and FabricJMame for 
the selected Switch is written, logically isolating the selected Switch fi-om any 
dynamically configured Switches in the Fabric. 

24. The method of claim 23, wherein the logical isolation of the selected Switch 

further comprises: 

receiving at the selected Switch a first message indicative of the selection of a 
Principal Switch from any of the dynamically configured switches; 

sending a reject message to any of the dynamically configured Switches that 
sent the first message; and 

isolating the Ports between the selected Switch and any of the dynamically 
configured Switches that sent the first message. 
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25. The method of claim 21, wherein providing the access to the Fabric further 
comprises providing access to remote party outside of the fabric. 

26. The method of claim 22, further comprising dynamically reconfiguring the 
Fabric by allowing the domain manager associated with the selected Switch to be 
enabled. 
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